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APPENDIX 



CLAIMS ON APPEAL 



1 . A method for processing video, the method comprising: 

determining an association between a first video segment including a particular feature 
and at least one additional information source also including that feature; and 

utilizing the association to display information from the additional information source 
based at least in part on a selection by a user of the feature in the first video segment wbile.the 
video segment is displayed to the user. 

2. The method of claim I wherein 

determining the association further includes 

retrieving the association from a memory. 

3. The method of claim 1 wherein 

determining the association further includes 

determining the association from information in a portion of the video 

segment, 

4. The method of claim 1 wherein 

the additional information source comprises 

an additional video segment also including the feature. 

5. The method of claim 4 wherein 

utilizing the association includes 

switching from display of the first video segment to display of the additional 
video segment also including the feature. 
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6. The method of claim 4 wherein 

utilizing the association includes 

displaying the additional video segment at least in part in a separate portion of 
a display which also includes at least a portion of the first video segment. 

7. The method of claim 1 wherein 

the feature is a video feature extracted from at least one frame of the video segment. 

8. The method of claim 7 wherein 

the video feature comprises at least one of 
a frame characterization, 
a face identification, 
a scene identification, 
an event identification, and 
an object identification. 

9. The method of claim 1 wherein 

the feature is an audio feature extracted from at least one frame of the video segment. 

10. The method of claim 9 wherein 

utilizing the association includes 

combining an audio signal corresponding to the audio feature with an audio 
signal associated with the first video segment. 

1 1 . The method of claim 9 wherein 

utilizing the association includes 

converting an audio signal corresponding to the audio feature into a textual 
format which is displayed with the first video segment. 
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12. The method of claim 9 further including 

separating at least a portion of the video segment into audio categories including one 
or more of 

single-voice speech, 
multiple-voice speech, music, 
silence and 
noise 

in order to extract the audio feature therefrom. 

13. The method of claim 9 wherein 

the audio feature comprises at least one of 
a music signature extraction, 
a speaker identification, and 
a transcript extraction. 

14. The method of claim 1 wherein 

the feature is a textual feature extracted from at least one frame of the video segment. 

15. The method of claim 14 wherein 

utilizing the association includes 

displaying information corresponding to the textual information as an overlay 
on a display of the first video segment. 

16. The method of claim 1 wherein 

determining the association further includes 

determining the association based at least in part on at least one multi- 
dimensional feature vector extracted from a portion of the video segment using a feature 
extraction technique. 
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1 7. The method of claim 1 wherein 

determining the association ftirther includes 

determining the association based at least in part on at least one of a similarity 
measure and a clustering technique. 

18. An apparatus for processing video, the apparatus comprising: 

a memory for storing an association between a first video segment including a 
particular feature and at least one additional information source also including that feature; 
and 

a processor coupled to the memory and operative to utilize the association to direct the 
display of information from the additional information source based at least in part on a 
selection by a user of the feature in the first video segment while the video segment is 
displayed to die user. 

19. An apparatus for processing video, the apparatus comprising: 

a processor operati ve 

(i) to determine an association between a first video segment including a 
particular feature and at least one additional information source also including that feature; 
and 

(ii) to utilize the association to display information from the additional 
information source based at least in part on a selection by a user of the feature in the first 
video segment while the video segment is displayed to the user. 

20. An article of manufacture comprising a machine-readable medium containing one or more 
software programs which when executed: 

determine an association between a first video segment including a particular feature 
and at least one additional information source also including that feature; and 

utilize the association to display information from the additional information source 
based at least in part on a selection by a user of the feature in the first video segment whi le the 
video segment is displayed to the user. 
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2 1 . A method for processing video, the method comprising: 

determining from information in a portion of a first video segment an association 
between a particular feature of the first video segment and at least one additional information 
source also including that feature; and 

utilizing the association to enable display of information from the additional 
information source when the first video segment is displayed. 

22. An apparatus for processing video, the apparatus comprising: 

a processor operative 

(i) to determine from information in a portion of a first video segment an 
association between a particular feature of the first video segment and at least one additional 
information source also including that feature; and 

(ii) to utilize the association to enable display of information from the 
additional information source when the first video segment is displayed. 

23. An article of manufacture comprising a machine-readable medium containing one or more 
software programs which when executed: 

determine from information in a portion of a first video segment an association 
between a particular feature of the first video segment and at least one additional information 
source also including that feature; and 

utilize the association to enable display of information from the additional 
information source when the video segment is displayed. 

24- A method for processing video, the method comprising: 

determining an association between (1) a portion of a video signal, the portion 
including a feature, and (2) at least one other information source also including the feature; 
and 

utilizing the association to enable display of information from the other information 
source based at least in part on a selection by a user of the feature in the portion of the video 
signal while the video segment is displayed to the user. 
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25. A method for processing video, the method comprising: 

determining from information in a portion of a video signal an association between a 
feature of the video signal and at least one other information source also including that 
feature; and 

utilizing the association to enable display of information from the other information 
source when the video segment is displayed. 
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